Rendering content

ABSTRACT

A method, apparatus as computer program is described comprising: obtaining or receiving content for presentation, wherein the content includes spatial audio data; rendering said content in a first direction; rendering said content in a second direction different to said first direction; and controlling the rendering of said content in said first direction and said second direction dependent, at least in part, on an angle between said first and second directions.

FIELD

The present specification relates to rendering content, for example torendering content for presentation, including spatial audio data.

BACKGROUND

A number of developments have been made in the field of renderingcontent, such as spatial audio data. There remains a need for furtherdevelopments in this field.

SUMMARY

In a first aspect, this specification provides an apparatus comprising:means for obtaining or receiving content for presentation, wherein thecontent includes spatial audio data; means for rendering said content ina first direction; means for rendering said content in a seconddirection different to said first direction; and means for controllingthe rendering of said content in said first direction and said seconddirection dependent, at least in part, on an angle between said firstand second directions.

In some examples, said content may include visual content.

In some examples, the means for rendering said content in the firstdirection and the means for rendering said content in the seconddirection form part of a single device.

Some examples include a first output means for providing said content inthe first direction and a second output means providing said content inthe second direction.

Some examples include means for selectively setting one of said firstdirection and said second direction as a primary direction and the otherof said first direction and said second direction as a secondarydirection.

In some examples, the means for controlling the rendering of saidcontent in said first direction and said second direction is configuredto output audio in mono in the event that neither of said first andsecond directions are set as the primary direction.

In some examples, the means for setting one of said first direction andsaid second direction as a primary direction sets said primary directionbased, at least in part, on a position of a user being addressed by saidcontent relative to one or more of said first direction and said seconddirection.

In some examples, the means for setting one of said first direction andsaid second direction as a primary direction sets said primary directionbased, at least in part, on a position of a user addressing theapparatus relative to one or more of said first direction and saidsecond direction.

In some examples, the means for controlling the rendering of saidcontent in said first direction and said second direction is configuredto modify the rendering of at least some spatial audio of the content inthe secondary direction such the modified spatial audio in the secondarydirection matches corresponding spatial audio of the content output inthe primary direction.

In some examples, the means for controlling the rendering of saidcontent in said first direction and said second direction is configuredto modify the rendering of said at least some spatial audio of thecontent in the secondary direction, wherein the modifying comprisesmirroring the respective spatial audio of the content output in theprimary direction, in the event that the secondary direction issubstantially opposite to the primary direction.

In some examples, the means for controlling the rendering of saidcontent in said first direction and said second direction is configuredto modify rendering of at least some of the visual content in thesecondary direction to match said spatial audio of the content output inthe primary direction.

In some examples, at least one of the first direction or the seconddirection are dependent on locations of one or more users of saidcontent.

Some examples include means for determining whether the angle betweensaid first direction and said second direction is above or below athreshold angle. In some examples, in the event that the angle is belowsaid threshold angle, the means for controlling the rendering of saidcontent in said first direction and said second direction is configuredto cause rendering of a single output across the means for rendering thecontent in the first direction and the means for rendering the contentin the second direction.

The means may comprise: at least one processor; and at least one memoryincluding computer program code, the at least one memory and thecomputer program code configured, with the at least one processor, tocause the performance of the apparatus.

In a second aspect, this specification describes a method comprising:obtaining or receiving content for presentation, wherein the contentincludes spatial audio data; rendering said content in a firstdirection; rendering said content in a second direction different tosaid first direction; and controlling the rendering of said content insaid first direction and said second direction dependent, at least inpart, on an angle between said first and second directions. In someexamples, said content may include visual content.

Some examples include selectively setting one of said first directionand said second direction as a primary direction and the other of saidfirst direction and said second direction as a secondary direction.

In some examples, the rendering of said content in said first directionand said second direction may be controlled to output audio in mono inthe event that neither of said first and second directions is set as theprimary direction.

In some examples, setting one of said first direction and said seconddirection as a primary direction sets said primary direction based, atleast in part, on a position of a user being addressed by said contentrelative to one or more of said first direction and said seconddirection. Alternatively, or in addition, in some examples setting oneof said first direction and said second direction as a primary directionsets said primary direction based, at least in part, on a position of auser addressing the apparatus relative to one or more of said firstdirection and said second direction.

In some examples, controlling the rendering of said content in saidfirst direction and said second direction modifies the rendering of atleast some spatial audio of the content in the secondary direction suchthe modified spatial audio in the secondary direction matchescorresponding spatial audio of the content output in the primarydirection.

In some examples, controlling the rendering of said content in saidfirst direction and said second direction modifies the rendering of saidat least some spatial audio of the content in the secondary direction,wherein the modifying comprises mirroring the respective spatial audioof the content output in the primary direction, in the event that thesecondary direction is substantially opposite to the primary direction.

In some examples, controlling the rendering of said content in saidfirst direction and said second direction modifies rendering of at leastsome of the visual content in the secondary direction to match saidspatial audio of the content output in the primary direction.

In some examples, at least one of the first direction or the seconddirection are dependent on locations of one or more users of saidcontent.

Some examples determining whether the angle between said first directionand said second direction is above or below a threshold angle. In someexamples, in the event that the angle is below said threshold angle,controlling the rendering of said content in said first direction andsaid second direction may cause rendering of a single output across themeans for rendering the content in the first direction and the means forrendering the content in the second direction.

In a third aspect, this specification describes an apparatus configuredto perform any method as described with reference to the second aspect.

In a fourth aspect, this specification describes computer-readableinstructions which, when executed by computing apparatus, cause thecomputing apparatus to perform any method as described with reference tothe second aspect.

In a fifth aspect, this specification describes a computer programcomprising instructions for causing an apparatus to perform at least thefollowing: obtaining or receiving content for presentation, wherein thecontent includes spatial audio data; rendering said content in a firstdirection; rendering said content in a second direction different tosaid first direction; and controlling the rendering of said content insaid first direction and said second direction dependent, at least inpart, on an angle between said first and second directions.

In a sixth aspect, this specification describes a computer-readablemedium (such as a non-transitory computer-readable medium) comprisingprogram instructions stored thereon for performing at least thefollowing: obtaining or receiving content for presentation, wherein thecontent includes spatial audio data; rendering said content in a firstdirection; rendering said content in a second direction different tosaid first direction; and controlling the rendering of said content insaid first direction and said second direction dependent, at least inpart, on an angle between said first and second directions.

In a seventh aspect, this specification describes an apparatuscomprising: at least one processor; and at least one memory includingcomputer program code which, when executed by the at least oneprocessor, causes the apparatus to: obtain or receive content forpresentation, wherein the content includes spatial audio data; rendersaid content in a first direction; render said content in a seconddirection different to said first direction; and control the renderingof said content in said first direction and said second directiondependent, at least in part, on an angle between said first and seconddirections.

In an eighth aspect, this specification describes an apparatuscomprising: one or more input modules configured to obtain or receivecontent for presentation, wherein the content includes spatial audiodata; one or more output modules configured to render said content in afirst direction and to render said content in a second directiondifferent to said first direction; and a control module configured tocontrol the rendering of said content in said first direction and saidsecond direction dependent, at least in part, on an angle between saidfirst and second directions.

BRIEF DESCRIPTION OF THE DRAWINGS

Example embodiments will now be described, by way of non-limitingexamples, with reference to the following schematic drawings, in which:

FIGS. 1 to 4 show views of devices in accordance with exampleembodiments;

FIG. 5 shows a system for multi-directional rendering of content inaccordance with an example embodiment;

FIG. 6 shows a system for multi-directional rendering of content inaccordance with an example embodiment;

FIG. 7 shows an apparatus in accordance with an example embodiment;

FIG. 8 is a flow chart showing an algorithm in accordance with anexample embodiment;

FIGS. 9 to 11 show systems for multi-directional rendering of content inaccordance with example embodiments;

FIG. 12 is a flow chart showing an algorithm in accordance with anexample embodiment;

FIGS. 13 to 15 show systems for multi-directional rendering of contentin accordance with example embodiments;

FIGS. 16 and 17 are flow charts showing an algorithm in accordance withan example embodiment;

FIGS. 18 to 20 show systems for multi-directional rendering of contentin accordance with example embodiments

FIG. 21 is a flow chart showing an algorithm in accordance with anexample embodiment;

FIG. 22 is a block diagram of components of a system in accordance withan example embodiment; and

FIGS. 23A and 23B show tangible media, respectively a removablenon-volatile memory unit and a Compact Disc (CD) storingcomputer-readable code which when run by a computer perform operationsaccording to example embodiments.

DETAILED DESCRIPTION

The scope of protection sought for various embodiments of the inventionis set out by the independent claims. The embodiments and features, ifany, described in the specification that do not fall under the scope ofthe independent claims are to be interpreted as examples useful forunderstanding various embodiments of the invention.

In the description and drawings, like reference numerals refer to likeelements throughout.

Mobile communication devices, such as mobile phones, with foldabledisplays are known. Such devices often have a single display. By way ofexample, some devices include a single display that can be folded awayinto a so-called “clam”; for example, to make the device smaller totransport. Displays of such devices may be divided into two or morevirtual displays. Moreover, it is possible to provide a device with twoor more physical displays. For example, devices with more than onephysical display may be effectively jointed together by sliding orfolding to create what appears to be a single larger display. Suchchanges in display configuration may result in a change in userinterface. For example, two display screens may first present twoseparate user interfaces, or one may duplicate the other. When a singledisplay is created, the device may switch to a joint user interface modewhere the screen real estate is effectively extended.

FIG. 1 shows views, indicated generally by the reference numeral 10, ofa device in accordance with an example embodiment. The views 10 of theshow a foldable device having two displays on the inside of a fold(although, as discussed further below, the foldable device may beimplemented using a single physical display, which is foldable). Afolding sequence is shown, starting from an almost flat (open)configuration 10 a and successively more closed configurations 10 b, 10c and 10 d.

FIG. 2 shows views, indicated generally by the reference numeral 20, ofa device in accordance with an example embodiment. The views 20 show afoldable device having two displays on the outside of a fold. A foldingsequence is shown, starting from an almost flat (open) configuration 20a and successively more closed configurations 20 b, 20 c and 20 d.

FIG. 3 shows views, indicated generally by the reference numeral 30, ofdevices in accordance with example embodiments in which the foldablecorner of the devices have varying degrees of roundness. The views 30include a device 30 a with highly rounded corners, a device 30 b withmoderately rounded corners and a device 30 c with almost square corners.

FIG. 4 shows views, indicated generally by the reference numeral 40, ofa device in accordance with an example embodiment. The views 40 showthat the junction of the displays does not need to be at the foldingpoint. Thus, one of the displays may be on the “long” side of the deviceand the other on the shorter side or vice versa, as shown in thedisplays 40 a and 40 b respectively.

The views 10 to 40 are provided by way of example. The skilled personwill be aware of many alternative configurations that could be provided.

Voice conferencing and video conferencing are common use cases relatedto telephony and mobile communication device. A number of embodimentsrelated to voice and video conferencing are described below.

FIG. 5 show a system, indicated generally by the reference numeral 50,for multi-directional rendering of content in accordance with an exampleembodiment. The system 50 comprises a first user 51, a second user 52and a device (such as a mobile phone or a mobile communication device)indicated generally by the reference numeral 53. The device 53 has afirst display 54 directed generally towards the first user 51 and asecond display 55 directed generally towards the second user 52. Thesystem 50 shows a “standing-A” configuration in which the device 53 isstanding on two ends with the join between the two displays 54 and 55pointing upwards. The first display 54 and/or the second display 55 maybe used to provide a user interface to one or both of the first andsecond users 51 and 52. For example, audio and/or visual outputs may beprovided.

FIG. 6 show a system, indicated generally by the reference numeral 60,for multi-directional rendering of content in accordance with an exampleembodiment. The system 60 comprises the first user 51 and the seconduser 52 described above. The system further comprises a device (such asa mobile phone or a mobile communication device) indicated generally bythe reference numeral 63. The device 63 (which is similar to the device53 described above) has a first display 64 directed generally towardsthe first user 51 and a second display 65 directed generally towards thesecond user 52. The system 60 shows a “fallen-A” configuration in whichthe device 63 is laying on its side with the join between the twodisplays 64 and 65 pointing forwards such that one end of each displayis touching the surface on which the device in located. The firstdisplay 64 and/or the second display 65 may be used to provide a userinterface to one or both of the first and second users 51 and 52. Forexample, audio and/or visual outputs may be provided.

FIG. 7 shows an apparatus, indicated generally by the reference numeral70, in accordance with an example embodiment.

The apparatus 70 comprising a controller 71, one or more audio inputdevices 72 (such as microphones), one or more visual input devices 73(such as video cameras), one or more audio output devices 74 (such asloudspeakers), one or more visual output devices 75, (such as videodisplays), an external user or device 76 (e.g. via a network, such asthe Internet), and a memory 77. One of more of the elements of theapparatus 70 may be omitted in some example embodiments. Moreover, manyvariants to the apparatus 70 will be readily apparent to those ofordinary skill in the art.

FIG. 8 is a flow chart showing an algorithm, indicated generally by thereference numeral 80, in accordance with an example embodiment. Thealgorithm 80 may, for example, be implemented using the apparatus 70.

The algorithm 80 starts at operation 82 where content for presentationis obtained or received. The content may include spatial audio data andmay be audio-only content or may include visual and audio components(e.g. a videoconference). The said content may be received (e.g. as partof a videoconference) or obtained in some other way. For example, in theapparatus 70, the content may be received from the external device 76 orretrieved from the memory 77. The content may be received from a remoteuser (e.g. as part of a videoconference), but this is not essential toall embodiments.

At operation 84, the content is rendered in a first direction (e.g.using the first display 54 of the system 50 or the first display 64 ofthe system 60). At operation 86, content is rendered in a seconddirection (e.g. using the second display 55 of the system 50 or thesecond display 65 of the system 60). Clearly, the operation 84 and 86may be performed in a different order or at the same time.

In the algorithm 80, the second direction is typically different to thefirst direction. The operation 84 and/or the operation 86 may includecontrolling the rendering of said content dependent, at least in part,on an angle between said first and second directions (e.g. the anglebetween relevant displays of a device, such as the devices 53 or 63).The controlling of the rendering may be implemented by the controller71.

The content may be rendered in the first direction (in operation 84) byrendering the content on a first output means (such as the first display54 of the device 53 or the first display 64 of the device 63).Similarly, the content may be rendered in the second direction (inoperation 86) by rendering the content on a second output means (such asthe second display 55 of the device 53 or the second display 65 of thedevice 63). The first and second output means may be separate (e.g.separate displays), but could be implemented as two parts of a singledisplay (such as a foldable display).

The means for rendering the content in the first direction and the meansfor rendering said content in the second direction may form part of asingle device (such as the device 53 or the device 63 described above).The device may, for example, be foldable such that said angle ischangeable. As discussed further below, the operations 84 and 86 may becontrolled such that the rendering of the content in the first andsecond direction is dependent, at least in part, on the angle betweensaid first and second directions.

FIG. 9 show a system, indicated generally by the reference numeral 90,for multi-directional rendering of content in accordance with an exampleembodiment. The system 90 comprises a first user 91 and a second user 92(similar to the first and second users 51 and 52 described above) and adevice 93 (similar to the devices 53 and 63 described above). The device93 has a first display 94 directed generally towards the first user 91and a second display 95 directed generally towards the second user 92.

In the system 90, the first user 91 is a participant in an audio-visualteleconference (or perhaps a virtual reality (VR) teleconference) usingthe device 93. A face of a remote participant in the teleconference isvisible on the first display 94. Also shown in the system 90 are exampleaudio representations showing how spatial audio of the displayed contentis matched to the left and right side of the first user 91.

FIG. 10 show a system, indicated generally by the reference numeral 100,for multi-directional rendering of content in accordance with an exampleembodiment. The system 100 comprises the first user 91, the second user92 and the device 93 described above. In the system 100, the first user91 has changed position and the device 93 has tracked the position ofthe user and changed the display of the content (on the first display94) accordingly. Thus, the “first direction” referred to in theoperation 84 described above has changed. Note that both the audio andthe visual output in the first direction are changed relative to theoutputs of the system 90.

The systems 90 and 100 illustrate a single participant (the first user91) engaged in an audio-visual teleconference, with a second participant(the second user 92) optionally in attendance. A face of a remoteparticipant in the videoconference can be presented to the first user(using the first display 94) with the correct spatial audiopresentation, which may be dependent on the orientation of the firstuser 91 relative to the first display 94. In addition to modifying theaudio presentation, the visual representation of the remote user mayalso be modified dependent on the orientation of the first user relativeto the first display. For example, the visual representation of theremote user may be captured using 3D modelling or may be constructedusing templates. Clearly, other visual representations of the remoteuser are possible.

As noted above, in the systems 90 and 100, the second user 92 is anon-participating user. This is not essential.

FIG. 11 show a system, indicated generally by the reference numeral 110,for multi-directional rendering of content in accordance with an exampleembodiment. The system 10 comprises the first user 91 and the seconduser 92 described above and additionally comprises a device 113 (similarto the device 93). The device 113 has a first display 114 directedgenerally towards the first user 91 and a second display 115 directedgenerally towards the second user 92.

In the system 110, the first user 91 and the second user 92 are bothparticipants in an audio-visual teleconference, such as a virtualreality (VR) teleconference, using the device 113. A face of a remoteparticipant in the teleconference is visible (to the first user 91) onthe first display 114 and is also visible (to the second user 92) on thesecond display 115. Also shown in the system 110 are example audiorepresentations showing how spatial audio of the displayed content ismatched to the left and right side of the first user 91 and matched tothe left and right side of the second user 92.

The audio presented to the first and second users 91 and 92 tend tocontradict one another (with the left-side audio as presented to thefirst user 91 being output on the same side of the device 113 as theright-side audio as presented to the second user 92). This can lead toconfusion.

FIG. 12 is a flow chart showing an algorithm, indicated generally by thereference numeral 120, in accordance with an example embodiment.

The algorithm 120 starts at operation 122, where it is determinedwhether or not a primary direction is identified. The operation 122determines whether presentation to the first user 91 or the presentationto the second user 92 is considered to be the primary presentation (andhence to be the primary direction).

If a primary direction is identified in the operation 122, then primarycontent is rendered in the primary direction in operation 124 of thealgorithm 120 and secondary content is rendered in the secondarydirection in operation 126 of the algorithm 120. Clearly, the operation124 and 126 may be performed in a different order or at the same time.

If no primary direction is identified in the operation 122, then theaudio content is rendered in mono in operation 123 of the algorithm 120.

FIG. 13 shows a system, indicated generally by the reference numeral130, for multi-directional rendering of content in accordance with anexample embodiment.

The system 130 comprises the first user 91 and the second user 92described above and additionally comprises a device 133 (similar to thedevices 93 and 113). The device 133 has a first display 134 directedgenerally towards the first user 91 and a second display 135 directedgenerally towards the second user 92.

In the system 130, the first user 91 and the second user 92 are bothparticipants in an audio-visual teleconference, such as a virtualreality (VR) teleconference, using the device 133. A face of a remoteparticipant in the teleconference is visible (to the first user 91) onthe first display 134 and is also visible (to the second user 92) on thesecond display 135 (as indicated by the view 135 a). As shown in thesystem 130, the visual presentations to the first and second users areidentical and the audio content is provided to each user as mono audio.Accordingly, the system 130 shows example outputs in accordance with theoperation 123 of the algorithm 120 described above.

By rendering the audio output in mono to both users, confusion due tothe different understanding of left and right due to the differentpositions of the first and second users 91 and 92 can be avoided (at thepotential cost of reduction of immersion experienced by the users).

Thus, if neither of the first and second directions is set as theprimary direction, the rendering of the content in said first and seconddirection may output audio in mono (and may additionally provideidentical visual representations). However, in the event that one of thefirst and second directions is set as a primary direction, audio and/orvisual outputs in the two directions may be handled differently.

FIG. 14 shows a system, indicated generally by the reference numeral140, for multi-directional rendering of content in accordance with anexample embodiment.

The system 140 comprises the first user 91 and the second user 92described above and additionally comprises a device 143 (similar to thedevices 93, 113 and 133). The device 143 has a first display 144directed generally towards the first user 91 and a second display 145directed generally towards the second user 92.

In the system 140, the first user 91 and the second user 92 are bothparticipants in an audio-visual teleconference, such as a virtualreality (VR) teleconference, using the device 143. A face of a remoteparticipant in the teleconference is visible (to the first user 91) onthe first display 144 (as indicated by the view 144 a) and is alsovisible (to the second user 92) on the second display 145 (as indicatedby the view 145 a).

Assume that the first user 91 is defined as the primary user and contentis rendered to the first user in the operation 124. The content isrendered to the second user 92 in the operation 126.

At least some of the spatial audio content rendered to the second user92 in the operation 126 is modified to match corresponding spatial audioof the content output in the primary direction. Thus, as shown in FIG.14, the left audio as rendered to the first user 91 is presented to thesecond user 92 on the right (as indicated by the “common L” arrow);similarly, the right audio as rendered to the first user 91 is presentedto the second user 92 on the left (as indicated by the “common R”arrow). This results in common left and right audio being provided tothe two users, thereby reducing the likelihood of confusion.

In the system 140 (where the second direction is user is substantiallyopposite to the primary direction), the rendering of the content in thefirst and second directions may be controlled such that at least somespatial audio of the content in the primary direction is mirrored beforebeing presented in the secondary direction.

In addition to modifying (e.g. mirroring) of spatial audio data in thesecond direction, the corresponding visual data may be modified by asimilarly modification (e.g. mirroring) process. For example, as shownin FIG. 14, the view 144 a shows visual data presented in the primarydirection, including a first remote participant and a second remoteparticipant. The second remote participant is behind and to the right ofthe first remote participant. If spatial audio data is used, audio fromthe second remote participant will be rendered to the right of the firstremote participant (thereby aiding an immersive experience).

The view 145 a shows visual data presented in the secondary direction.Since the audio data has been modified such that audio to the right ofthe first rendering is presented on the left, a correspondingmodification to the visual representation has been implemented, suchthat the second remote participant now appears behind and to the left ofthe first remote participant.

It should be noted that spatial mirroring may involve moving thelocation of faces within a displayed output (rather than mirroring ofthe faces themselves). In circumstances where mirroring has occurred,this may be indicated as part of the output as presented to the relevantviewer.

FIG. 15 shows a system, indicated generally by the reference numeral150, for multi-directional rendering of content in accordance with anexample embodiment.

The system 150 shows the transition from a scenario in which a monoaudio output is provided (as in the system 130 described above) to ascenario in which the primary and secondary content are rendereddifferently (similar to the system 140 described above). The transition(indicated by the arrow 152) may be controlled in a number of ways, twoof which are discussed further below.

FIG. 16 is a flow chart showing an algorithm, indicated generally by thereference numeral 160, in accordance with an example embodiment.

The algorithm 160 starts at operation 162, where a remote user isaddressing one of the first and second users 91 and 92. The user beingaddressed is identified in operation 162 and the primary direction isset in operation 164 accordingly.

For example, the first and second users 91 and 92 may be taking part ina videoconference with one or more remote users. The videoconferenceoutput may be presented as separate displays to the first and secondusers, with identical visual representations and mono audiorepresentations. In the event that a selected one of the first andsecond users is being addressed, a transition 152 occurs such that thedisplay of the addressed user is the first display and the display ofthe other user is the second display. The audio and/or visual outputsprovided to the second user may therefore be modified as discussedabove.

A number of mechanisms may be provided to enable a remote user tospecifically address one of the first and second users. A user interfaceinput may be provided (e.g. a selection made from a list).Alternatively, a name of the addressed user may be mentioned.Alternatively, or in addition, a remote user may turn to arepresentation (e.g. an AR/VR avatar) of the user that they wish toaddress.

By way of example, a remote user may wish to say something to the firstuser 91 (for example), whilst remaining audible and visible to thesecond user 92 (and any other participant). In this case, the remoteuser may appear to turn away from the second user 92, with the audiodirected to the second user being handled accordingly.

FIG. 17 is a flow chart showing an algorithm, indicated generally by thereference numeral 170, in accordance with an example embodiment.

The algorithm 170 starts at operation 172, where one of the first andsecond users 91 and 92 is identified as addressing the remote user. Atoperation 174, the primary direction is set accordingly. The operation172 may be implemented in many different ways. For example, theoperation 172 may simply identify whether either the first user 91 orthe second user 92 is talking, with a talking user being set as theprimary user.

FIG. 18 shows a system, indicated generally by the reference numeral180, for multi-directional rendering of content in accordance with anexample embodiment. The system 180 comprises a first user 91 and thesecond user 92 described above and device 181 (similar to the devices93, 113, 133 and 143) having a first display directed generally towardsthe first user 91 and a second display directed generally towards thesecond user 92. The system 180 also includes a remote user 182 and adisplay 183 that is providing a visual output (and optionally an audiooutput) to the remote user 182.

In the system 180, the direction in which the remote user 182 is talkingmay be identified (e.g. using a camera). The remote user's (virtual)orientation relative to the first and second users may be presentedappropriately using the displays of the device 181. Alternatively, or inaddition, the display 183 may render spatial audio and spatial video ofthe first and second users such that the first and second user appear tothe remote user 182 to be in different locations on the wide display182.

FIG. 19 shows a system, indicated generally by the reference numeral190, for multi-directional rendering of content in accordance with anexample embodiment. The system 190 comprises a first user 91 and thesecond user 92 described above and device 191 (similar to the devices93, 113, 133, 143 and 181) having a first display directed generallytowards the first user 91 and a second display directed generallytowards the second user 92. In the system 190, the display 190 is usedin a so-called “fake 3D” configuration.

The display 191 is used to display a face of a remote user, with theface being presented 25 on both of the first display 192 and the seconddisplay 193 such that the face is rendered with a slight 3D effect. Thisis achieved in the static viewing direction case because the displayconfiguration forms a curve or angle that roughly resembles the 3D shapeof the face. This has the advantage that a remote user face can be madevisible on a relatively small display for users who are facing eachother (e.g. sitting in two very different directions relative to thedevice 191). Furthermore, this configuration allows for a spatial audiopresentation that is non-mono for the local users. The remote usertherefore can appear as a “third person at the table”.

FIG. 20 shows a system, indicated generally by the reference numeral200, for multi-directional rendering of content in accordance with anexample embodiment.

The system 200 shows a first configuration, indicated generally by thereference numeral 201, in which a display is being used in the “fake 3D”configuration described above with respect to FIG. 19 and a secondconfiguration, indicated generally by the reference numeral 202 in whichthe display is being used to provide separate outputs to the first andsecond user. The configuration may be dependent on the angle between thefirst and second displays of the display device.

FIG. 21 is a flow chart showing an algorithm, indicated generally by thereference numeral 210, in accordance with an example embodiment. Atoperation 212 of the algorithm 210, a determination is made regardingwhether or not the angle between said first and second directions isabove or below a threshold angle. At operation 214, a configuration isset accordingly. For example, a single output may be provided across thetwo displays of the device (e.g. the fake 3D effect described above) ifthe angle is below the threshold angle and separate outputs may beprovided on the two displays if the angle is above the threshold angle.

For completeness, FIG. 22 is a schematic diagram of components of one ormore of the modules for implementing the algorithms described above,which hereafter are referred to generically as processing systems 300. Aprocessing system 300 may have a processor 302, a memory 304 coupled tothe processor and comprised of a RAM 314 and ROM 312, and, optionally,viewer inputs 310 and a display 318. The processing system 300 maycomprise one or more network interfaces 308 for connection to a network,e.g. a modem which may be wired or wireless.

The processor 302 is connected to each of the other components in orderto control operation thereof.

The memory 304 may comprise a non-volatile memory, a hard disk drive(HDD) or a solid state drive (SSD). The ROM 312 of the memory 304stores, amongst other things, an operating system 315 and may storesoftware applications 316. The RAM 314 of the memory 304 is used by theprocessor 302 for the temporary storage of data. The operating system315 may contain code which, when executed by the processor, implementsaspects of the algorithms 80, 120, 160, 170, and 210.

The processor 302 may take any suitable form. For instance, it may be amicrocontroller, plural microcontrollers, a processor, or pluralprocessors. Processor 302 may comprise processor circuitry.

The processing system 300 may be a standalone computer, a server, aconsole, or a network thereof.

In some embodiments, the processing system 300 may also be associatedwith external software applications. These may be applications stored ona remote server device and may run partly or exclusively on the remoteserver device. These applications may be termed cloud-hostedapplications. The processing system 300 may be in communication with theremote server device in order to utilize the software application storedthere.

FIG. 23A and FIG. 23B show tangible media, respectively a removablememory unit 365 and a compact disc (CD) 368, storing computer-readablecode which when run by a computer may perform methods according toembodiments described above. The removable memory unit 365 may be amemory stick, e.g. a USB memory stick, having internal memory 366storing the computer-readable code. The memory 366 may be accessed by acomputer system via a connector 367. The CD 368 may be a CD-ROM or a DVDor similar. Other forms of tangible storage media may be used.

Embodiments of the present invention may be implemented in software,hardware, application logic or a combination of software, hardware andapplication logic. The software, application logic and/or hardware mayreside on memory, or any computer media. In an example embodiment, theapplication logic, software or an instruction set is maintained on anyone of various conventional computer-readable media. In the context ofthis document, a “memory” or “computer-readable medium” may be anynon-transitory media or means that can contain, store, communicate,propagate or transport the instructions for use by or in connection withan instruction execution system, apparatus, or device, such as acomputer.

Reference to, where relevant, “computer-readable storage medium”,“computer program product”, “tangibly embodied computer program” etc.,or a “processor” or “processing circuitry” etc. should be understood toencompass not only computers having differing architectures such assingle/multi-processor architectures and sequencers/parallelarchitectures, but also specialised circuits such as field programmablegate arrays FPGA, application specify circuits ASIC, signal processingdevices and other devices. References to computer program, instructions,code etc. should be understood to express software for a programmableprocessor firmware such as the programmable content of a hardware deviceas instructions for a processor or configured or configuration settingsfor a fixed function device, gate array, programmable logic device, etc.

As used in this application, the term “circuitry” refers to all of thefollowing: (a) hardware-only circuit implementations (such asimplementations in only analogue and/or digital circuitry) and (b) tocombinations of circuits and software (and/or firmware), such as (asapplicable): (i) to a combination of processor(s) or (ii) to portions ofprocessor(s)/software (including digital signal processor(s)), software,and memory(ies) that work together to cause an apparatus, such as aserver, to perform various functions) and (c) to circuits, such as amicroprocessor(s) or a portion of a microprocessor(s), that requiresoftware or firmware for operation, even if the software or firmware isnot physically present.

If desired, the different functions discussed herein may be performed ina different order and/or concurrently with each other. Furthermore, ifdesired, one or more of the above-described functions may be optional ormay be combined. Similarly, it will also be appreciated that the flowdiagrams of FIGS. 8, 12, 16, 17, and 21 are examples only and thatvarious operations depicted therein may be omitted, reordered and/orcombined.

It will be appreciated that the above described example embodiments arepurely illustrative and are not limiting on the scope of the invention.Other variations and modifications will be apparent to persons skilledin the art upon reading the present specification.

Moreover, the disclosure of the present application should be understoodto include any novel features or any novel combination of featureseither explicitly or implicitly disclosed herein or any generalizationthereof and during the prosecution of the present application or of anyapplication derived therefrom, new claims may be formulated to cover anysuch features and/or combination of such features.

Although various aspects of the invention are set out in the independentclaims, other aspects of the invention comprise other combinations offeatures from the described embodiments and/or the dependent claims withthe features of the independent claims, and not solely the combinationsexplicitly set out in the claims.

It is also noted herein that while the above describes various examples,these descriptions should not be viewed in a limiting sense. Rather,there are several variations and modifications which may be made withoutdeparting from the scope of the present invention as defined in theappended claims.

The invention claimed is:
 1. An apparatus comprising: at least oneprocessor; and at least one non-transitory memory including computerprogram code; the at least one memory and the computer program codeconfigured to, with the at least one processor, cause the apparatus atleast to perform: obtain content for presentation, wherein the contentincludes spatial audio data; render said content in a first direction;render said content in a second direction different to said firstdirection; selectively set one of said first direction or said seconddirection as a primary direction; selectively set the other of saidfirst direction or said second direction as a secondary direction; andcontrol the rendering of said content in said first direction and saidsecond direction dependent, at least in part, on an angle between saidfirst and second directions, wherein control of the rendering of saidcontent in said first direction and said second direction comprisesmodifying the rendering of at least some of the spatial audio data ofthe content rendered in the secondary direction so as to modify aperceived direction associated with the at least some of the spatialaudio data to match a perceived direction of corresponding spatial audiodata of the content rendered in the primary direction, wherein themodifying of the rendering of the at least some of the spatial audiodata of the content rendered in the secondary direction is configured tomodify a spatial location of the at least some of the spatial audio datato be a first location relative to the primary direction, wherein aspatial location of the corresponding spatial audio data rendered in theprimary direction is the first location relative to the primarydirection.
 2. An apparatus as claimed in claim 1, further comprising oneor more displays in a single device wherein rendering said content inthe first direction and rendering said content in the second directionis done via the one or more displays.
 3. An apparatus as claimed inclaim 2, wherein said device is foldable such that said angle ischangeable.
 4. An apparatus as claimed in claim 1, wherein the at leastone memory and the computer program code are further configured to, withthe at least one processor, cause the apparatus to perform: render saidcontent in the first direction via a first display and rendering saidcontent in the second direction via a second display in a single device.5. An apparatus as claimed in claim 1, wherein selectively setting oneof said first direction or said second direction as the primarydirection comprises setting said primary direction based, at least inpart, on a position of a user being addressed with said content relativeto one or more of said first direction or said second direction.
 6. Anapparatus as claimed in claim 1, wherein selectively setting one of saidfirst direction or said second direction as the primary directioncomprises setting said primary direction based, at least in part, on aposition of a user addressing the apparatus relative to one or more ofsaid first direction or said second direction.
 7. An apparatus asclaimed in claim 1, wherein controlling the rendering of said content insaid first direction and said second direction comprises modifying therendering of said at least some of the spatial audio data of the contentrendered in the secondary direction so as to mirror the perceiveddirection of the corresponding spatial audio data of the contentrendered in the primary direction, where the secondary direction issubstantially opposite to the primary direction.
 8. An apparatus asclaimed in claim 1, wherein said content includes visual content.
 9. Anapparatus as claimed in claim 8, wherein controlling the rendering ofsaid content in said first direction and said second direction comprisesmodifying rendering of at least some of the visual content in thesecondary direction to match said corresponding spatial audio data ofthe content rendered in the primary direction.
 10. An apparatus asclaimed in claim 1, wherein at least one of the first direction or thesecond direction are dependent on locations of one or more users of saidcontent.
 11. An apparatus as claimed in claim 1, wherein the at leastone memory and the computer program code are further configured to, withthe at least one processor, cause the apparatus to perform: determinewhether the angle between said first direction and said second directionis above or below a threshold angle, wherein controlling the renderingof said content in said first direction and said second directioncomprises rendering of a single output in the first direction and in thesecond direction, in the event that the angle is below said thresholdangle.
 12. A method comprising: obtaining content for presentation,wherein the content includes spatial audio data; rendering said contentin a first direction; rendering said content in a second directiondifferent to said first direction; selectively setting one of said firstdirection or said second direction as a primary direction; selectivelysetting the other of said first direction or said second direction as asecondary direction; and controlling the rendering of said content insaid first direction and said second direction dependent, at least inpart, on an angle between said first and second directions, wherein thecontrolling of the rendering of said content in said first direction andsaid second direction comprises modifying the rendering of at least someof the spatial audio data of the content rendered in the secondarydirection so as to modify a perceived direction associated with the atleast some of the spatial audio data to match a perceived direction ofcorresponding spatial audio data of the content rendered in the primarydirection, wherein the modifying of the rendering of the at least someof the spatial audio data of the content rendered in the secondarydirection is configured to modify a spatial location of the at leastsome of the spatial audio data to be a first location relative to theprimary direction, wherein a spatial location of the correspondingspatial audio data rendered in the primary direction is the firstlocation relative to the primary direction.
 13. A method of claim 12,wherein rendering said content in the first direction and rendering saidcontent in the second direction is done via one or more displays of anapparatus.
 14. A method of claim 12, comprising: providing said contentin the first direction and providing said content in the seconddirection.
 15. A non-transitory computer readable medium comprisingprogram instructions stored thereon for performing at least thefollowing: obtain content for presentation, wherein the content includesspatial audio data; render said content in a first direction; rendersaid content in a second direction different to said first direction;selectively set one of said first direction or said second direction asa primary direction; selectively set the other of said first directionor said second direction as a secondary direction; and control therendering of said content in said first direction and said seconddirection dependent, at least in part, on an angle between said firstand second directions, wherein control of the rendering of said contentin said first direction and said second direction comprises modifyingthe rendering of at least some of the spatial audio data of the contentrendered in the secondary direction so as to modify a perceiveddirection associated with the at least some of the spatial audio data tomatch a perceived direction of corresponding spatial audio data of thecontent rendered in the primary direction, wherein the modifying of therendering of the at least some of the spatial audio data of the contentrendered in the secondary direction is configured to modify a spatiallocation of the at least some of the spatial audio data to be a firstlocation relative to the primary direction, wherein a spatial locationof the corresponding spatial audio data rendered in the primarydirection is the first location relative to the primary direction.